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Abstract. We study the combinatorics of ad-nilpotent ideals of a Borel subalgebra 
of sZ(n+ 1, C). We provide an inductive method for calculating the class of nilpotence 
of these ideals and formulas for the number of ideals having a given class of nilpotence. 
We study the relationships between these results and the combinatorics of Dyck 
paths, based upon a remarkable bijection between ad-nilpotent ideals and Dyck paths. 
Finally, we propose a (q, t)-analogue of the Catalan number Cn- These {q,t) -Catalan 
numbers count on the one hand ad-nilpotent ideals with respect to dimension and 
class of nilpotence, and on the other hand admit interpretations in terms of natural 
statistics on Dyck paths. 



§1 Introduction 

Let be a complex simple Lie algebra of rank n. Let f) C g be a fixed Cartan 
subalgebra, A the corresponding root system of q. Fix a positive system A"*" in 
A, and let 11 = {ai, . . . , an} be the corresponding basis of simple roots. For each 
a G A""" let Qa be the root space of g relative to a, n = ga, and b be the Borel 

a6A+ 

subalgebra b = f) © n. 

Let X" denote the set of a(i-nilpotent ideals (i.e., consisting of ad-nilpotent el- 
ements) of b. These ideals, together with the subclass X^j, of Abelian ideals, have 
been studied in [6]. In that paper, Kostant stated a useful equivalence criterion 
for certain decomposably-generated simple i^-submodules of A(g) in terms of X"^ 
(here, X is a compact semi-simple Lie group, and g is the complexification of its 
Lie algebra). Moreover, he used the set of Abelian ideals to describe the eigenspace 
relative to the maximal eigenvalue of the Laplace-Beltrami operator of K. 

The subclass X^j, has been studied much more recently in [7] in connection with 
discrete series representations. The latter paper was partly motivated by a strik- 
ing enumerative result due to D. Peterson: the Abelian ideals are 2"^ in number, 
independently of the type of g. (In contrast, the cardinality of X" depends on the 
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type; see [1, Th. 3.1]). Even more surprising is the proof of Peterson's result, which 
involves the affine Weyl group W of q. In [1], the encoding of the ideals through 
certain elements of the afSne Weyl group has been generalized from X^j^ to the entire 
set of ad-nilpotent ideals. There it was shown that any such ideal determines 
in a combinatorial way the set of "inversions" of a unique element in W. 

The combinatorial methods used in [1] entailed the problem of enumerating the 
ideals of with respect to class of nilpotence. By definition, the class of nilpotence 
of an ideal i, which we denote here by n(i), is the smallest number m such that 
m-fold bracketing of i with itself gives the zero ideal. (Thus, the Abelian ideals are 
exactly those with class of nilpotence at most 1.) A solution to the problem, for q 
of type An, was obtained in [10], where it was shown that the number of ideals in 
X" with class of nilpotence k is given by 



The purpose of this paper is to deepen and enhance the imdcrstanding of the 
enumerative properties of ad-nilpotent ideals of a fixed Borcl subalgebra of sl{n + 
1,C). First of all, after having recalled the algebraic preliminaries in Section 2, we 
describe in Section 3 a fast combinatorial algorithm for the computation of the class 
of nilpotence of a given ideal (see Proposition 3.2). (We remark that it is based 
on a "slow" algorithm, see Proposition 3.1, which has interesting relations to the 
elements of the affine symmetric group that are obtained by the main result of [1] 
mentioned earlier; see the remarks at the end of Section 3.) 

This algorithm implies naturally a partition into subintervals of the interval 
[(0, ... , 0), (n, n — 1, . . . ,1)] in the Young lattice, see Proposition 4.1 in Section 4. 
From this partition, the formula (1.1) follows immediately, thus providing a proof 
different from the one in [1] (see Theorem 4.2). 

However, formula (1.1) gives much more. Since expressions like the one in (1.1) 
occur in the theory of Dyck paths, it links the enumeration of ad-nilpotent ideals 
to the enumeration of Dyck paths. To be precise, we prove that there are as many 
ad-nilpotent ideals of a fixed subalgebra of sl{n + 1,C) with class of nilpotence 
k as there are Dyck paths of length 2n + 2 with height k + 1 (see Theorem 4.4). 
As there are numerous formulas available for the number of these Dyck paths, we 
obtain immediately alternative expressions for the number of these ad-nilpotent 
ideals, see Theorem 4.5 in Section 4. In particular, formula (4.6) must be preferred 
over formula (1.1), as it is much simpler and computationally superior. Curious 
outcomes of these results are, for example, the observation that the number of ad- 
nilpotent ideals with class of nilpotence at most 2 (instead of 1, as in Peterson's 
result) is a Fibonacci number, as well as the observation that the number of ad- 
nilpotent ideals with class of nilpotence at most 3 is essentially a power of 3, see 
Corollary 4.7. 

In Section 5 we make the connection between ad-nilpotent ideals and Dyck paths 
completely explicit, by exhibiting a bijection between acZ-nilpotent ideals in sl{n + 
1, C) with class of nilpotence k and Dyck paths of length 2n + 2 with height k+1. 

The subject of Section 6 is an apparently new {q, t)-analogue of Catalan num- 
bers. (In particular, it is unrelated to the (g, t)-Catalan numbers of Garsia and 
Haiman [4].) It counts arf-nilpotent ideals in sl{n + 1,C) simultaneously with re- 
spect to dimension and class of nilpotence. As it results directly from the earlier 



0=io <ii< - ■ ■ <ik <ik + i=n+l j=0 





(1.1) 
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mentioned interval decomposition, it is composed out of a rather straightforward 
(g, t)-extension of formula (1.1), see Theorem 6.1. In terms of combinatorics, for 
q — 1 this {q, t)-Catalan number reduces to the generating function for Dyck paths 
counted with respect to height, whereas for t = 1 it reduces to the generating 
function for Dyck paths counted with respect to area. 

Our combinatorial analysis allows us to provide precise results concerning the 
minimal and maximal dimension of an ideal with fixed class of nilpotence, and 
the minimal and maximal class of nilpotence of an ideal with fixed dimension. In 
terms of our (q, i)-analogue of the Catalan number this amounts to determining 
the minimal and maximal degree in the variable q once the degree in t is fixed, and 
vice versa. All this is also found in Section 6, see Theorems 6.2 and 6.3. 

We now fix the notation that will be used throughout the paper. As usual, we 
denote the set of integers by Z. For binomial coefficients, we will use the following 
convention: Given integers m and n, we let 

({ m! 
(m—n] 

Similarly, we define the t-binomial coefficient by 

if m > n > 0, 
if n = 0, 

in any other case. 



if m > n > 0, 
if n = 0, 

in any other case. 



m 
n 



m— n ! n 



where the t-factorial [m]! is defined by [m]l — [m][m — 1]---[1], [0]! = 1, with 
\i] = if-l)/{t-l). 

Finally, for a partition A = (Ai, . . . , A„), Ai > • • • > A^ > 0, we write |A| for the 
size Yl7=i °^ ^- "^^^^ identify a partition A = (Ai, . . . , A„) with its Ferrers 
diagram, which is the array of cells with n left-justified rows, the zth row being of 
length A^. For example. Figure 1 shows the (Ferrers diagrams of the) partitions 
(3, 2, 1) and (3, 1). The cell in the ith. row and jth. column will be always identified 
with the pair 



Figure 1 



We call a cell of a diagram a corner cell, if there are no cells to the right and 
to the bottom. For example, the corner cells of the diagram (corresponding to the 
partition) (3, 1) are the cells labelled (1, 3) and (2, 1) (which are marked by bullets 
in Figure 1). 
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§2 Algebraic preliminaries 

Let i e X"^, i.e., i is an ad-nilpotent ideal of our fixed Borel subalgebra b. Clearly, 
we can write i as i = 0a, for some collection $ of positive roots. The collection 

$ encodes an ideal i e X"' if and only if for all a e ^> and (3 e A+ such that a + P 
is a root, we have a + /3 G If one endows A+ with the (restriction of the) usual 
partial order on the root lattice, that is, for ct,/? G A+ we let a < /3 if and only if 
(3 — a — ''77' f*-*^ some nonnegative integers c^, then this can be phrased 

differently as follows: ^» encodes an ideal if and only if it is a dual order ideal in 
A+. 

In the rest of the paper we will exclusively deal with q of type A^, i.e., the Lie 
algebra sl{n + 1,C) of (n + 1) x (n + 1) traceless matrices. The last observation 
of the previous paragraph allows us to represent ad-nilpotent ideals conveniently 
in a geometric fashion, which will be crucial in all subsequent considerations (see 
also [1, Sec. 3]). Clearly, any positive root in can be written as a sum of simple 
roots. Explicitly, let us write Tij — ai + ■ ■ ■ + a„_j_|_i, 1 < i < n, l<j<n — i + l. 
If we place the roots Tij, j = 1, 2, . . . , n — z + in the ith row of a diagram, then this 
defines an arrangement of the positive roots in a staircase fashion. For example, 
for A^ we obtain the arrangement 

Ctl + Q!2 + 0:3 Cti + Q!2 Ctl 

Q!2 + Q!3 Q!2 

Q!3 

Obviously, the above defines an identification of positive roots with cells of the 
staircase diagram {n,n — 1, . . . , 1), in which the root is identified with the cell 
(i,j). For example, for ^3, the root cti + a2 is identified with cell (1,2) in the 
diagram (3, 2, 1), shown on the left in Figure 1. 

Given an ad-nilpotent ideal i, written as i = 5a: ^or some collection $ of 

aE$ 

positive roots, we can use the above identification to represent i as the set of cells 
that correspond to the roots in $. Since, as we noted above, i is a dual order ideal, 
the set of cells obtained forms a (Ferrers diagram of a) partition. For example, 
the ideal Sai+aa+as © 0ai+a2 ® 0ai ® flaj+as Corresponds to the partition (3, 1, 0), 
shown on the right in Figure 1. Clearly, this correspondence is reversible as long 
as the partition is contained in (n, n — 1, . . . , 1). Thus, we have defined a bijection 
between ad-nilpotent ideals in s/(n + 1, C) and subdiagrams of (n, n — 1, . . . , 1). In 
particular, as it is well-known that the number of the latter subdiagrams is C„_|_i, 
C'n = ':;^Cn) being the n-th Catalan number, the number of ad-nilpotent ideals 
is equal to the (n + l)st Catalan number (see [12, Sec. 2] and also [1, Sec. 3]). 

§3 Calculating the class of nilpotence 

The goal of this section is to describe a fast algorithm to determine the class 
of nilpotence for any given ad-nilpotent ideal i. As a first step, we describe a 
tableau algorithm which computes the descending central series of i (i.e., the m- 
fold bracketings of i with itself, for any m). More precisely, let Uj be the maximal 
number m such that the root space Q^i occurs in 




m occurrences of i 
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Then we claim that the numbers tij can be obtained as follows. Let A be the 
subdiagram of (n, n — 1, . . . , 1) that corresponds to i according to the identification 
explained in Section 2. Define a filling (tij)i<i<n, i<i<n-i+i of the cells of (n,n — 
!,...,!) by recursively setting 

rO if(^,j)^A, 

tij = < 1 (*'-^) ^ corner cell of A, (3.1) 

max {ti,k + tn-k+2,j} otherwise. 

V j<fc<n— i+l 

It is easy to see that the above rule uniquely defines a filling of (n, n — 1, . . . , 1), 
whose nonzero entries are precisely those corresponding to the cells of A. E.g., when 
n = 4, the fillings corresponding to (2, 1, 0, 0), (3, 3, 2, 1), (4, 3, 2, 1) are respectively 

1100 3210 4321 

100 321 321 

2 1 2 1 

1 1 

For the verification of our claim it suffices to observe that if C i" and 0/3 C 
then, under the assumption that a + (3 is a root, Qa+p Q i""'"''. For, with our 
labelling of positive roots, a sum Ti^k + '^'ij is a root if and only if l = n — k + 2 (or 
i = n—j + 2, which, however, is the same case by symmetry), in which case we have 
Ti,k + Tn-k+2,j = Tij. Thus, if, for some k with j < k < n — i + 1, we know that g^-. ^ 
occurs in 1** '= and that 0^- , , „ . occurs in i*"-'=+2,j then it follows that Qr occurs 
in i*i,fe+*Ti-fe+2j Clearly, the maximum of all possible numbers ti^k + tn-k+2,j, is 
equal to the maximal possible exponent m such that Qrij ^ i"^- This is exactly the 
content of (3.1). 

Let us summarize our findings so far in the proposition below. 

Proposition 3.1. Let i G J". Then, for any with 1 < i < n and 1 < j < 

n — i + 1, the maximal number tij such that Qt.j ^ i*"'-' can be determined by the 
tableau algorithm given in (3.1). In particular, the class of nilpotence of i is equal 
to ti^i, the entry in the top-left cell. 

In view of the second statement of Proposition 3.1, this tableau algorithm pro- 
vides an algorithm for the determination of the class of nilpotence, which, how- 
ever, is rather slow, as it involves the determination of all the entries in the filling 
(tij). We will now show that, if one is only interested in the determination of 
ti^i (which, by the second statement of Proposition 3.1 gives exactly the class of 
nilpotence), then a considerable speedup can be achieved. For a convenient state- 
ment of the result, we write, in abuse of notation, n(Ai, A2, . . . , A„) for n(i), given 
that the partition corresponding to i according to the construction in Section 2 is 
(Ai, A2, . . . , An). 

Proposition 3.2. Let i G X"' and let A = (Ai, . . . , A^) be the corresponding parti- 
tion. // A ^ (0, 0, . . . , 0) then 

n(Ai, A2, . . . , An) = n(An+2-Ai, • • • , An) + 1. (3.2) 

It should be noted that on the left-hand side of (3.2) appears the class of nilpo- 
tence of an ideal in X", whereas on the right-hand side there appears the class of 
nilpotence of an ideal in T'^^~^ (with corresponding partition (A„+2-Ai5 ■ ■ ■ , ^n))- 
The computation, however, can be carried out completely formally, without refer- 
ence to ideals, which we now demonstrate by an example. 
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Example. Let i G X^^ be the ideal which corresponds to the partition (10, 10, 9, 6, 
5,4,4,3,1,1,1,1,0). (This is the partition in Figure 2. At this point, all dotted 
lines should be ignored.) Then, by applying Proposition 3.2 iteratively, we obtain 
for the class of nilpotence of i 

n(i) = r?,(10, 10, 9, 6, 5, 4, 4, 3, 1, 1, 1, 1, 0) 
= n(5, 4, 4, 3,1,1,1,1,0) + ! 
= n(l,l,l,0) + 2 
= 3. 

As is obvious from the example, iterated application of Proposition 3.2 provides 
a very efficient algorithm of determining the class of nilpotence of a given ideal i. 

Before we move on to the proof, we wish to point out that this algorithm has a 
very nice geometric rendering. Let, as before, A = (Ai, A2, . . . , A^) be the partition 
corresponding to i. Consider the Ferrers diagram of A. As it is contained in the 
staircase diagram (n, n — 1, . . . , 1), it must not cross the antidiagonal line x -\- y = 
n + 1. We draw a zig-zag line as follows (see Figure 2, where n = 13 and A = 
(10, 10, 9, 6, 5, 4, 4, 3, 1, 1, 1, 1, 0)): we start on the vertical edge on the right of cell 
(1, Ai), and move downward until we touch the antidiagonal x -\- y = n-\- 1. At the 
touching point we turn direction from vertical-down to horizontal-left, and move 
on until we touch a vertical part of the Ferrers diagram. At the touching point we 
turn direction from horizontal-left to vertical-down. Now the procedure is iterated, 
until we reach the line a; = 0. The class of nilpotence of the ideal i is equal to the 
number of touching points oyi x -\-y = n-\-l. In Figure 2, the resulting zig-zag line 
is the dotted line outside the Ferrers diagram of (10, 10, 9, 6, 5, 4, 4, 3, 1, 1, 1, 1, 0). 
There are three touching points on x + y = n -|- 1 = 14. (At this point, the dotted 
lines inside the diagram should still be ignored.) 




Figure 2 
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Since we need it in the proof of Proposition 3.2, and also later, let us express 
this geometric rendering in formal terms. Obviously, the zig-zag line describes the 
shape of a partition 

{ir"'+\i^i^''-\...,i^-'\G''-') , (3.3) 

where ik = Ai, ik-i = Xn-ik+2, ik-2 = K-ik-i+2, ■■■ , H = K-i2+2- Clearly 
we have < zi < • • • < z/e < n + 1. (In Figure 2, we have k = 3 and = 10, 
^2 = 5, zi = 1.) Any partition A which gives rise to this zig-zag line must necessarily 
contain the cells (1, ik), {n-ik + 2, ik-i), {n - ik-i + 2, ik-2), ■■ ■ , (n - Z2 + 2, ii). 
(In Figure 2, these are the cells (1, 10), (5, 5), (10, 1).) The "minimal" partition (in 
the sense of inclusion of diagrams) which contains these cells is 

{ik,i^+\^j;''-\...,i^-'\0'^-') . (3.4) 

(In Figure 2, this "minimal" partition is indicated by the dotted lines inside the 
Ferrers diagram of (10, 10, 9, 6, 5, 4, 4, 3, 1, 1, 1, 1, 0).) For later use, let us denote the 
partition in (3.3) by A^^ j^, and the partition in (3.4) by AJ^^*^ j^. 

Proof of Proposition 3. 2. We first show that the class of nilpotence is at least as 
large as the number, k say, which is typed out by the algorithm, in its geometric 
rendering. Let ii, . . . ,ik be as above, < ii < ■ ■ ■ < i/j < n -|- 1. As we already 
noted, the partition A contains the cells {l,ik), in — ik + 2,ik-i), ('^"U-i +2, U-2), 
. . . , {n— 12+2,11). In view of the correspondence of Section 2, these cells correspond 
to the root spaces Qn , 5 0r„_i +2 i ^ ■ ■ ■ ■> 0r„_i +2 i contained in the ideal i. The 
bracket of 

is simply Qn ■ (In particular, it is nontrivial.) Hence, the class of nilpotence of i 
is at least k, as was claimed. 

In order to see that the class of nilpotence does not exceed k, we consider the 
ideal, say, which corresponds to the partition Xff (see (3.3)). Clearly, this 
ideal contains i. Hence, its class of nilpotence is an upper bound for the class of 
nilpotence of i. However, as is seen by inspection, the tableau algorithm (3.1) yields 
the following for A^ j^: the entry where n — is + 2<i<n — ig-i + 2 and 
V-i < J < ir, is given by s — r. (Here, by convention, we have put io :— and 
ik+i := n + 1.) In particular, the top- left entry, ti^i, which by Proposition 3.2 
yields the class of nilpotence of t^, is equal to {k + 1) — 1 — k. Hence, the class of 
nilpotence of i cannot exceed k, and thus must be equal to k. □ 

At the end of this section, we want to relate Proposition 3.1 to the main result 
from [1] , the latter setting up a connection between ad-nilpotent ideals and elements 
of the affine Weyl group for any type of g. 

Let A and W be the affine real root system and the affine Weyl group associated 
to A [5]. Having fixed a positive system A"'" in A, we have a corresponding positive 
system A+ = (A+ + N6) U (-A+ + Z+6) in A {6 is the "imaginary root"). 

For $ C A+, set = (^^^-^ + $) n A. If moreover $ is a dual order ideal in 
A+ (cf. the first paragraph of Section 2), define 

y i-^'^ + kd). 
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Set N{w) = {a G A"'" | w~^{a) G A~}, where A~ = —A"*". It is well known 
that N{w) determines w uniquely. The main result of [1] is the following theorem, 
which holds for any simple Lie algebra. 

Theorem 3.3. Consider the ideal i$ G X"' defined by = ® fla? where $ is 

a dual order ideal in A'^ . Then there exists a unique G W such that g$ = 
N{w^). Moreover is the minimal set of the form N(v), v & W (w.r.t. inclusion) 
containing —^ + S. 

Proposition 3.4. Let i$ G be as in Theorem 3.3 and let (tij) be the corre- 
sponding filling of {n,n — 1, . . . ,1) (cf Section 3). Then 

N{w^) = y {-Ty + M I 1 < /i < ti,j} . 

l<i<j<n 



Proof. This is immediate from Proposition 3.1. □ 

This result admits the following interpretation. Recall that, in type W can 
be realized as the group of affine permutations [8] : 



W ^ {w-.Z^Z \w{t + n + 1) = w{t) + n + 1 Vt G Z, 



Proposition 3.4, together with [11, Th. 1] or [13, Th. 3.2], shows that the filling 
determines the inversion table [2, Sec. 8] of thought of as an afiine permutation. 
In different terms, 

— ; = ti,n-j+2, l<^<J<n+l. 

n+1 J 

One can be even more explicit by using [13, Th. 5.2]. Namely, for 1 < i < n + 1, 
we have 

i-l n+1 
/(i) = i + tj,n-i+2 - ^ tt,n-j+2- 



Problem. Find a combinatorial characterization of the affine permutations 
that correspond, as described above, to ad-nilpotent ideals. 

§4 Enumeration of ad-NiLPOxENx ideals 

In this section we provide several formulae for the number of ad-nilpotent ideals 
having a fixed class of nilpotence. The point of departure is a remarkable partition 
of the interval [(1, . . . , 0) , (n, n — 1, . . . , 1)] in the Young lattice that is implied by the 
fast algorithm for the determination of class of nilpotence given in Proposition 3.2. 
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Proposition 4.1. (a) The interval I = [(0, ... , 0), (n, n — 1, . . . ,1)] in the Young 
lattice can be decomposed into disjoint suhintervals as 

n 

~ U U [\i,...,ik^\i,...,ik^^ 

k=0 0=io<ii<---<ifc<ifc+i=n+l 

where and Xf^ are defined by (3.4) and (3.3), respectively. 

(b) Let i 6e an ideal with corresponding partition X. If X & [A^,...,i^.) j^], then 

the class of nilpotence of i is equal to k. 

Proof. This follows immediately from the geometric rendering of Proposition 3.2 
(see the remarks after the statement of Proposition 3.2) and the arguments given 
in the proof of Proposition 3.2. □ 

Theorem 4.2. The number of ideals in with class of nilpotence k is equal to 

0=io<ii<---<ifc<ife+i=n+l j=0 ^ ^ ^ 

Proof. By Proposition 4.1 we have to count the number of partitions A with 
^h,... ,ik — ^ — ^h,--- ,ik^ when ii, . . . ,ik vary. For fixed . . . , ifc the corresponding 
number is easily determined: the interval [A™^ i^^^^h ... ui decomposes into the 
product of k Young lattices as follows, 

[0,((^fc-^/c-l)"-^'=)] X [(/},{{ik-i-ik-2Y'-'''-'-')] 

X [0, {{ik-2 - ik-sY'-'-''-'-')] X • • • X [0, {iT-''-')] . (4.2) 

(Here, stands for the empty partition.) This decomposition is most obvious 
from Figure 2. There, the dotted lines mark the partitions A"^ , and Xf'^ 
(with k = 3, iz = 10, Z2 = 5, zi = 1). As is obvious from the picture, the 
dotted lines determine k (in Figure 2, we have A; = 3) "independent" rectangles. 
So, if A G [A^ j^,A^ j^], there is only freedom within the rectangles, which 
is expressed by the decomposition (4.2). As the number of partitions which are 
contained in a rectangle (a'') is equal to the binomial coefficient ("^^) , the result 
follows. □ 

Corollary 4.3. The number of ideals in T" with class of nilpotence at most h is 
equal to 

O=io<h<---<ih<ih+i=n+l j=0 ^ 3 + / 

Proof. According to Theorem 4.2, we have to sum the expression (4.1) over k from 
to h. Because of our convention for binomial coefficients (cf. the introduction), 
this does indeed yield (4.3). For, if in (4.3) we encounter ij and ij+i with ij = 
and j > 1, then the binomial coefficient i^.~^^~"^) , which occurs in the 

summand, vanishes. Hence, the only nonzero contributions in (4.3) are by indices 
= zo = zi = • • • = ih-k < h-k+i < • ■ • < ih < h+i = n + 1, for some k. 
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Because of our convention that ( q^) =1, the corresponding summand reduces to 
a term which appears in the sum (4.1), upon replacement of ij by ij-h+k, j = 
h-k,h-k + l,...,h + l. □ 

This coroUary makes the hnk of the enumeration of ad-nilpotent ideals in sl{n + 
1,C) to the enumeration of Dyck paths. Recall that a Dyck path is a lattice path 
from (0,0) to (2n, 0) with diagonal step vectors (1,1) and (1,-1) which does not 
pass below the x-axis. We define the height of a Dyck path to be the maximum 
ordinate of its peaks. 

Theorem 4.4. The number of ideals in T"" with class of nilpotence k is exactly the 
same as the number of Dyck paths from (0, 0) to (2n + 2, 0) with height k 

Proof. The expression (4.3) occurs in [3, Proposition 3.B]. (There, replace n by 
n + 1, Uj by ih-j+i — ih-j, ^j^j+i by j = 0, 1, . . . , /i, and extract the coefficient 
of x^^^.) If this is combined with Corollary 2 in [3], then it follows that the 
expression (4.3) is equal to the number of Dyck paths from (0, 0) to {2n + 2, 0) 
with height at most h + 1. Clearly, since by Corollary 4.3 we know that it also 
equals the number of ideals in X'^ with class of nilpotence at most h, this implies 
the result. □ 

An immediate question is, of course, whether it is possible to provide an explicit 
bijection between the ideals and Dyck paths in Theorem 4.4. We are going to 
construct such a bijection in Section 5. (It should be noted that the obvious corre- 
spondence between ideals and partitions that we described in Section 2 cannot serve 
this purpose. Although the border of a partition contained in (n, n — 1, . . . , 1) can 
be viewed as a Dyck path if the Ferrers diagram is rotated by 45° in the negative 
direction, this correspondence does not convert class of nilpotence of the ideal into 
height of Dyck paths. For example, under this correspondence, the zero ideal, the 
unique ideal with class of nilpotence 0, translates into the unique Dyck path with 
height n-h 1, i.e., the Dyck path with n+1 up-steps followed by n-|- 1 down-steps.) 

The enumeration of Dyck paths (and of lattice paths in general) is a well-explored 
territory, where many explicit results exist. In view of Theorem 4.4, these may now 
be used to obtain results for ideals with a given class of nilpotence. 

Theorem 4.5. The number of ideals in X"' with class of nilpotence at most h is 
{aside from (4.3)) equal to any of the following expressions: 



l<i,j<n 



2k{h + 3) + lf 2n+3 



2n+3 \n+l-k(h + 3) 



(4.6) 



Proof. We observe that, instead of counting Dyck paths, we may equivalently count 
lattice paths from (0, 0) to (n + 1, n-|- 1) with step vectors (1, 0), (0, 1) which do not 
touch the lines y = x — 1 and y — x + h + 2. Then the determinantal expressions 
follow from [9, Ch. 2, Th. 1], while (4.6) results from [9, Ch. 1, Th. 2] upon little 
simplification. □ 
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Generating function results for Dyck paths translate into the following result for 
ideals with a given class of nilpotence. 

Theorem 4.6. Let Un{x) denote the nth Chebyshev polynomial of the second kind, 
Un{cost) = sin((n+ l)t)/ smt, or, explicitly. 



j>0 \ J / 



2j 



Let an{h) denote the number of ideals in with class of nilpotence at most h. 
Then 



1 



1 - 



X 

1 



X 



(In the continued fraction there are h-\-l occurrences of x.) 

Proof. The expression in terms of a quotient of Chebyshev polynomials follows, for 
example, from [3, Prop. 12], while the continued fraction follows from Flajolet's 
continued fraction [3, Th. 1]. □ 

By specializing this generating function result to /i = 1, we recover Peterson's 
result (in type An) that the number of Abelian ideals (i.e., the ideals with class of 
nilpotence at most 1) in X"' is 2"'. If we specialize Theorem 4.6 to /i = 2 and /i = 3, 
we may obtain further enumeration results, which are equally remarkable. 

Corollary 4.7. The number of ad-nilpotent ideals in T^ with class of nilpotence 
at most 2 is the Fibonacci number F2n- The number of ad-nilpotent ideals in 
with class of nilpotence at most 3 is (3" + l)/2. 

§5 A BIJECTION BETWEEN ad-NILPOTENT IDEALS AND DYCK PATHS 

Now we describe a bijection between ideals in T"^ with class of nilpotence k and 
Dyck paths from (0, 0) to {2n + 2, 0) with height A; + 1. 

Let i e X"^, and let A be the corresponding partition contained in (n, n — 1, . . . , 1), 
according to the correspondence described in Section 2. The first step consists of 
determining the interval, according to the decomposition of Proposition 4.1, the 
partition A is in. I.e., we determine the integers i^, i^-i, . . . , ii such that A e 
[Kl,...,t^^^il,...,i^- To use the example of Section 3, A = (10, 10, 9, 6, 5, 4, 4, 3, 1, 1, 1, 
1, 0) (with n — 13), we have A; = 3, is = 10, i2 = 5, ii — 1. Figure 2 shows this 
partition. The dotted line outside indicates the partition Xff = Xf^^^io, the 
dotted line inside indicates AT* = XV^r, m. 
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a. 




c. 

Figure 3 



Now one generates a Dyck path step by step. One starts with n + l~ik up-down 
pieces (in our example: k — 3 and n + 1 — ik = n -\- 1 — is = 4; see Figure 3. a). 

In order to explain the next steps, we need to observe (as we did already earlier) 
that the interval [A^^ j^, j^] pictorially decomposes into k independent rect- 
angles. In the example of Figure 2, these are the rectangles formed by the dotted 
lines, the top-most rectangle being a 3 x 5 rectangle, the next a 4 x 4 rectangle, 
and the bottom-most a 3 x 1 rectangle (see Figure 2). 

Now, in the top-most rectangle, we follow the shape of A inside the rectangle, 
from top-right to bottom-left. In our example of Figure 2, this shape is dldllldl, 
the letter d indicating a down-step in the shape, the letter I indicating a left- 
step. Thus, to the portion of the shape contained in the rectangle corresponds a 
word l°''^dl°'^d. . . . We insert ao up-down pieces into the first peak of the 

already existing Dyck path (which, by now, is just a zig-zag line; see Figure 3. a), ai 
up-down pieces into the second peak, etc. In our example this generates the Dyck 
path in Figure 3.b. 

This procedure is now repeated, by considering the remaining rectangles one- 
by-one, from top to bottom. From now on, up-down pieces are only inserted into 
highest peaks. To continue our example, the next shape portion to be considered 
(the one contained in the 4x4 rectangle) is Iddldlld. Hence, 1 up-down piece is 
inserted into the first peak (of height 2, since only highest peaks are considered for 
insertions) in Figure 3.b, up-down pieces into the second peak, etc. 

The final result of this procedure, applied to the partition in Figure 2, is shown 
in Figure 3.c (i.e., after also having considered the bottom-most rectangle). 

It is obvious that the result of this mapping is a Dyck path with height k + 1. 
Conversely, given a Dyck path with height k + 1, it is obvious how to reverse the 
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mapping and obtain the corresponding partition A, and, thus, the corresponding 
ideal i with n(i) = k. Therefore we have found the desired bijection. 



§6 A (g, t)-ANALOGUE OF THE CATALAN NUMBER 

As wc said in the introduction, the total number of ad-nilpotent ideals of a Borel 
subalgebra of sl{n + 1, C) is the Catalan number Cn+i- Let an{h, k) be the number 
of such ideals with dimension h and class of nilpotence k. Then the generating 
function 

h,k>0 

is a (g, t)-analogue of the Catalan number C„+i. (It is unrelated to the Garsia- 
Haiman (g, t)-Catalan number [4]. This can be seen, for example, by recalling that 
the Garsia-Haiman {q, t)-Catalan number is symmetric in q and t, whereas our 
(g, t)-Catalan number is highly nonsymmetric.) 

Define the area A{P) of a Dyck path P as the area of the region between P and 
the X-axis. Our (q, t)-Catalan number has the following properties. 

Theorem 6.1. We have 



k-i 



t 



k=0 yo=io<ii<---<ifc<ifc+i=n+l i=0 

' (6.1) 

with ik+2 = n + 2. Cn{q, 1) is the generating function for Dyck paths from (0,0) 

to (2?i + 2, 0) counted with respect to height. C„(l,t) is the generating function for 
the same set of Dyck paths with respect to the weight function (n + 1)^/2 — A{-). 

Proof. The expression (6.1) is obtained by following along the arguments of the 
proof of Theorem 4.2. That is, for fixed class of nilpotence, we use the decomposi- 
tion (4.2) (see also Figure 2). This reduces the problem to the problem of finding 
the generating function summed over all partitions A which are contained 

in an a X 6 rectangle. As is well-known (cf., e.g., [14, Prop. 1.3.19]), this is the 

t-binomial coefficient . Thus, we obtain the expression (6.1). 

The claim about Cn(i?, 1) is the content of Theorem 4.4. For the proof of the 
claim about (7^(1, t) we use the correspondence of Section 2 between ideals i and 
partitions A contained in (n, n — 1, . . . , 1). Under this correspondence, the dimension 
of the ideal i is converted into the size |A| of the partition. If we rotate the Ferrers 
diagram of A by 45° in the negative direction, then the border of the Ferrers diagram 
forms a Dyck path, the area of which is exactly equal to (n -1-1)^/2 — |A|. □ 

We are now going to investigate extremal properties, with respect to dimension 
and class of nilpotence, of ad-nilpotent ideals. First, we fix the class of nilpotence 
to k, say, and ask what the possible dimensions of ideals with class of nilpotence 
k is. I.e., the task is to determine the minimal and maximal possible dimension 
of an ideal under the assumption that its class of nilpotence is k. Let us denote 
the minimal possible dimension by ^™'"(/c) and the maximal possible dimension by 
9^^^{k). In terms of our (g, t)-Catalan number Cn{q,t), we ask for the minimal 
and maximal degree in the variable t among the terms which have degree k in q. 
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Theorem 6.2. We have 
and 

n + 1 
2 



k + 1 



+ {k-l){n-k), 



(6.2) 



Or''ik)={ , -(n+1) 



n + 1 
k + 1 



Proof. In view of the correspondence between ideals and partitions given in Sec- 
tion 2, determining ^™^°(A;) amounts to finding the partitions A = (Ai, A2, . . . , An) 
contained in the staircase (n, n — 1, . . . , 1) with minimal size |A| under the condi- 
tion that n(A) = k (i.e., under the condition that the algorithm of Proposition 3.2 
outputs k for A). It is easily seen that under this assumption we must have Ai > k. 

Formula (6.2) yields ^^^"(1) = 1. On the other hand, we have n(l, 0, . . . , 0) = 1 
independent of the number of zeroes, since the dimension of the ideal associated 
to (1,0,... ,0) is always 1. Let us now prove the formula by induction on k. We 
begin by observing that if A = (Ai, A2, . . . , A^) is a partition with n{X) = k + 1 and 
|A| minimal, then, applying Proposition 3.2, one deduces that |(An+2-Ai) • • • ,^n)\ 
has to be minimal, too. Thus, we have to fix Ai between k+1 and n, and then 
take a partition rj which realizes 0™^2-\iik)j which we then complete to a parti- 
tion realizing 9™^^{k + 1) in the following way: if rj = (s, .. .), then we take A as 
(Ai, s'^~^i, . . . ). We thus have 

C'"(A; + 1)= min min {r + {n - r)s + e^ll{k)} . 

k+l<r<n k<s<r—l 

By induction, 6'™'"(/c) = (^+^) + {s-l){k-l), and so 

9r'"(k+l)= min min \r + (n - r)s + + (r - 1 - k)(k - 1)\ . 

^ ^ k+l<r<n k<8<r-l I ^ ^ ^ ^ ^ ) 

Since n >r and A; > 1, the minimum on s is reached for s = k, and so 

e'^'''{k + l)= min \r + nk-rk+!^^^+r{k-l)-{k^ -1)\ . 

Thus, 

+ 1) = ^^mm^ Jn/c + - /c^ + 1} = + ^) + fc(n - /c - 1) , 

which is what we wanted to prove. 

Now we consider the case of the maximum. We want to find partitions A, con- 
tained in the staircase (n, n — 1, . . . , 1), with exactly k outer corners on the antidi- 
agonal x + y = n + 1, such that their size |A| is maximal. 

Let us consider such a partition A, see Figure 4 for an example, in which n = 9 
and = 3, the partition being (6, 6, 6, 6, 5, 2, 2, 2, 0). Let us write no = n + 1 — Xi, 
Hi = Xi — A2, . . . , Hk-i = Afc_i — Afe, and Hk — Afe. See Figure 4 for the geometric 
meaning of these quantities, where //o = 4, /xi = 1, /X2 = 3, //3 = 2. Clearly, 
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1^3 9 




X + y — n + 1 



Figure 4 



n + 1 = /J-o + Hi + ■ ■ ■ + iJ-k, i-e., fx = (/Uq, /Ui, . . . , (Ufc) is a composition of n + 1 
with exactly k + 1 parts. Moreover, the composition fi determines the partition A 
uniquely. Therefore we may as well encode a partition with all its outer corners on 
the antidiagonal x + y = n+ lhy the corresponding composition 
We will base our argument on the following two easily verified facts: 

Fact 1. Let A be a partition (with all outer corners on x -\- y — n + 1) with 
corresponding composition fi. Let ji' be a composition which arose from jj. by 
permuting the parts. Then the partition corresponding to jj! has the same size as 



Fact 2. Let A be a partition with exactly k outer corners, all of them on x + y = 
n + 1, such that its size is maximal with respect to such partitions. Then, in 
the corresponding composition = (/xq, /^i, . . . , //fe): we have — < 1 for 

% ^— 1 ^ 2^ . . . ^ A/ . 

Both facts combined say that, in order to find a partition with exactly k outer 
corners, all of them on x + y = n + 1, such that its size is maximal, we are looking 
for a partition whose corresponding composition h has the property that any two 
of its parts differ by at most 1. Thus, is a composition with at most two different 
parts, one being [(n + l)/{k + 1)J, and the other being \{n + l)/{k + 1)]. Clearly, 
the latter must appear n + 1 — (k + l) |_(n + l)/{k + 1)J times, whereas the former 
must appear {k — n + {k + 1) [{n + l)/{k + 1)J) times. If one does the required 
algebra, then one obtains that the size of such a partition is exactly the expression 
on the right hand side of (6.3). □ 

Now we fix the dimension to A, say, and ask what the possible classes of nilpo- 
tence of ideals with dimension A is. Le., now the task is to determine the minimal 
and maximal possible classes of nilpotence of an ideal under the assumption that its 
dimension is A. Let us denote the minimal possible class of nilpotence by 0™'"(/c) 
and the maximal possible class of nilpotence by ©™^^(/c). In terms of our {q,t)- 
Catalan number C^(g, t), we ask for the minimal and maximal degree in the variable 
q among the terms which have degree A in t. 



A. 
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Theorem 6.3. We have 



Gr(^) = niin^fc: f +^)-(n+l) 



n + 1 
k + 1 



n+l 
k+1 



+ 1 



>A\, (6.4) 



and 



(6.5) 



Proof. Let us first consider the maximum. We denote the expression on the right 
hand side of (6.2) by m{k). Furthermore let Kq — max{/c : m{k) < A}. Equiva- 
lently, we have 

m{KQ) <A<m{Ko + l). (6.6) 

It is obvious that ©™^^(A) < Kq. We would like to prove equality, because that 
yields immediately (6.5) upon a straightforward calculation. 

In order to establish 0™'^^(A) = Xq, we consider the partition Aq = (i^o, {Kq — 
Y^n-Ko+i ^ i^o ~ 2, . . . , 2, 1), which realizes the minimum in (6.2) (with k = Kq), 
i.e., |Ao| = m(K'o)- It is the lower bound of the interval 

[{Kq, {Kq - l)-^o+i^ - 2, . . . , 2, 1), {K^+'-^'^Kq -1,Kq^2,...,2, 1)] 

^ [^T,2,...,Ko^^h2,...,Ko] (6-7) 

in the decomposition guaranteed by Proposition 4.1. Recall that all partitions A in 
this interval satisfy n(A) = Kq. The size of Xf^2 Kq equal to (^°) + {n + Kq — 
1)Kq, which is exactly m{KQ + 1) — 1. Hence, because of (6.6), we will be able to 
find a partition in the interval (6.7) with size A. This establishes (6.5). 

Now we turn to the minimum. Although the idea is analogous, the details are 
more elaborate. 

We denote the expression on the right hand side of (6.3) by M{k). Furthermore 
let Ki = min{A; : M{k)> A}. Equivalently, we have 



M{Ki) >A> M{Ki - 1). 

It is obvious that Q^^^{A) > Ki. We would like to prove equality. 
In order to establish Q^^^{A) = Ki, we consider the partition 



(6.8) 



Ai 



+ 1- 



n+l 
Ki + 1 



r(n+l)/(Ki + l)l 



, (n + 1 - 2 

/ \ L(n+l)/(i^i + l)J / 



n+l 



n+l 



- \ r(n+l)/(i^i+l)l 
Ki + 1 ) 

L(n+l)/(i^i + l)J 



) 



), (6.9) 



(to be precise, the partition corresponding to the composition [ x^^i J ^) ^ 

where we have abbreviated a = n + 1 — {Ki + 1) L"^74~[J ^ind b = Ki — n + (Ki + 
1) [ see the second part of the proof of Theorem 6.2), which realizes the 
maximum in (6.3) (with k — Ki), i.e., |Ai| = M{Ki). It is the upper bound of the 
interval 
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where 



n+l 



n+l 



n+1-2 



n + 1- 



n+l 
Ki + 1 



in the decomposition guaranteed by Proposition 4.1. Recall that all partitions A in 
this interval satisfy n(A) = Ki. As a moderately tedious computation shows, the 



size of A 



{ii,...,iKi) 



is equal to 



r+^)-(3n + 4) 



n+l 



+ (3Ki + 5)(L(n+l)/(Ki + l)J+l^ ^ -^^ ^ ^^^^^^ 



(n+l) _ (3^ + 5) -tl_ + (3Ki + 5)((n+l)/(Ji + l) + l) 



if (Ki + 1) I (n+l). 

(6.11) 

If we are able to establish that this value is less than or equal to M{Ki — 1) + 1, 
then, because of (6.8), we will be able to find a partition in the interval (6.10) with 
size A. This would establish (6.4). 

In fact, it turns out that the preceding claim is only true for Ki > 1. Hence, we 
will treat the case of Ki — 1 separately at the end of the proof. 

Let Ki > 1. First, the claim is easily verified directly for Ki = n (in which case 
the expression in the second line of (6.11) has to be used). Second, we verify our 
claim for n = 1, 2, . . . , 6. This is readily done with the help of a computer. (It can 
even be done by hand.) Thus, in the sequel, we may assume that Ki < n — 1 and 
n>7. 

Since the expression in the second line in (6.11) is smaller than the expression 
in the first line, it suffices to prove that the expression in first line is less or equal 
to M{Ki — 1) + 1. That is, we must show 



n + l 
2 



(3n + 4) 



< 



n + l 
i^i + 1 
n + l 
2 



+ (3Ki + 5) 

n + l 



-(n+l) 



L(n+l)/(Ki + l)J + l 
2 

L(n + 1)/Kij + 1 



+ i^i 



+ 1 



This inequality is equivalent to 

n + l 



< (3n + 4) 



Ki + l 



- (3i^i + 5) 



L(n + l)/(i^i + l)J + l 



L(n + 1)/Kij + 1 



(n+l) 



n + l 



+ 1. (6.12) 



It should be observed that, as long as Ki is between n/2 + 1 and n — 1, the right 
hand side of (6.12) is linear and monotone decreasing in Ki. On the other hand, it 
is trivially true for Ki = n — 1. Hence, it is true for all Ki > n/2 + 1. This allows 
us to assume Ki < (n + l)/2 from now on. 

The expression on the right hand side of (6.12) is quadratic in [(n + 1)/Ki\ , with 
the minimum of the quadratic polynomial at {n + 1) / Ki — 1/2. Thus, if we would 
be able to prove (6.12) with [(n + 1)/Ki\ replaced by {n + l)/Ki — l/2, the original 
inequality would be established. Similarly, the right hand side of (6.12) is quadratic 
in [(n+ l)/{Ki + 1)J. Therefore, depending on whether [(n + l)/{Ki + 1)J is to 
the right or to the left of the maximum of the corresponding quadratic polynomial. 
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it suffices to prove (6.12) with [{n + l)/(i^i + 1)J replaced by (n + l)/{Ki + 1), 
respectively {n — Ki + 1) / (Ki + 1). 

In summary, we will be done once we have established the inequalities 

(-8n - 12Ki - 9Ki^ - - 4 - 4Kir? 

- 16Kin + SKi'^n^ - SKi^n - lOKi^ - K^^) 

°- 8Ki(Ki + l)2 ' 

(6.13) 

corresponding to replacing [(n + 1)/Ki\ by {n+l)/Ki — l/2 and |_(n + l)/{Ki + 1)J 
by {n+l)/{Ki + 1) in (6.12), and 

(-8n - 12^1 + 19Ki^ - - 4 - AKin'^ ~ IQKiu 

< - - - - — 

8Ki(Ki + l)2 

(6.14) 

corresponding to replacing |_(n + 1)/Ki\ by (n+l)/Ki — 1/2 and |_(n + l)/{Ki + 1)J 
by {n-Ki + l)/{Ki + 1) in (6.12). 

We concentrate on the proof of (6.13). The proof of (6.14) is similar. 

First of all, it can be verified directly that (6.13) is true for Ki = 2 and n > 
7. Therefore, from now on, we may assume Ki > 3. Next we differentiate the 
expression on the right hand side of (6.13) with respect to Ki, thus obtaining 

{n^{8Ki^ - 16Ki^ - 12Ki - 4) + n(16Ki^ - 32^1^ - 2AKi - 8) 

+ Ki^ + SJCi^ + llKi^ - 15Ki^ - 12Ki) 
8Ki2(Ki + 1)3 ■ 

This is most evidently negative for Ki > 3. Hence, the right hand side of (6.13) 
is monotone decreasing for Ki > 3. Thus, if we are able to verify (6.13) for the 
maximal Ki that we are considering, i.e., Ki = (n + l)/2, then (6.13) is established 
for all Ki between 3 and (n + l)/2. Now, if we substitute Ki = {n + l)/2 into 
(6.13), we obtain 

(n+l)(15n2-70n-217) 
16(n + 3)2 ' 

which is positive for n > 7, as desired. 

Finally, we treat the case Ki = 1. In that case, because of (6.8), our given size 
A must satisfy 1 < A < [{n + l)/2j \{n + l)/2]. If A > n, then there is a partition 
in the interval [-^|^„_|_i)/2j ' -^[(L+i)/2j] with size A. Otherwise, there is a partition in 
the interval [/{", if^] with size A. 

This completes the proof of the theorem. □ 
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